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1 Introduction 

In their paper [22], Myasnikov, Nikolaev, and Ushakov started the investigation 
of classical discrete integer optimization problems in general non-commutative 
groups. Among other problems, they introduced for a finitely generated (f.g.) 
group G the knapsack problem and the subset sum problem. The input for 
the knapsack problem is a sequence of group elements gi,.. ., , g £ G and 

it is asked whether there exists a solution (an,..., Xk) € N fc of the equation 
9i 1 ''' 9k k = 9- For the subset sum problem one restricts the solution to {0, l} fe . 
For the particular case G = Z (where the additive notation x\-gi+- ■ ■+Xk-gk = g 
is usually prefered) these problems are NP-complete if the numbers gi ,..., gk, g 
are encoded in binary representation. For subset sum this is shown in Karp’s 
classical paper [13]. The statement for knapsack (in the above version) can be 
found in [10]. 

In [22] the authors enocde elements of the finitely generated group G by 
words over the group generators and their inverses. For G = Z this representa¬ 
tion corresponds to the unary encoding of integers. It is known that for unary 
encoded integers, knapsack and subset sum over Z can be both solved in polyno¬ 
mial time, and the precise complexity is DLOGTIM E-uniform TC° [6], which is 
a very small complexity class that roughly speaking captures the complexity of 
multiplying binary coded integers. In [22], Myasnikov et al. proved the following 
new results: 

• Subset sum and knapsack can be solved in polynomial time for every 
hyperbolic group. 
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• Subset sum for a virtually nilpotent group (a finite extension of a nilpotent 
group) can be solved in polynomial time. 


• For the following groups, subset sum is NP-complete (whereas the word 
problem can be solved in polynomial time): free metabelian non-abelian 
groups of finite rank, the wreath product 1\ Z, Thompson’s group F , and 
the Baumslag-Solitar group BS(1, 2). 

In this paper, we continue the investigation of knapsack and subset sum for 
arbitrary groups. We prove the following results, where as in [22] group elements 
are represented by finite words over the group generators and their inverses: 

• For every virtually nilpotent group, subset sum belongs to NL (nondeter- 
ministic logspace). 

• There is a polycyclic group with an NP-complete subset sum problem. 

• There is a nilpotent group of class two for which knapsack is undecidable. 
This nilpotent group is a direct product of sufficiently many copies of the 
discrete Heisenberg group //--.(Z). In [18], the second author proved that 
there exists a nilpotent group (of large class) for which knapsack is unde¬ 
cidable. Here we improve this result to class two and at the same time 
simplify the construction from [18]. As a byproduct of our construction, 
we show that there exists a fixed nilpotent group of class two together 
with four finitely generated abelian subgroups Gi, G 2 , G 3 , G 4 such that 
membership in the product G 1 G 2 G 3 G 4 is undecidable. It is known that 
membership in a product of two subgroups of a polycyclic group is decid¬ 
able [16]. 

• The knapsack problem for the the discrete Heisenberg group H^(X) is 
decidable. In particular, together with the previous point it follows that 
decidability of knapsack is not preserved under direct products. 

• The class of groups with a decidable knapsack problem is closed under 
finite extensions. 

• The knapsack problem is decidable for every co-context-free group. Recall 
that a group is co-context-free if the complement of the word problem is 
a context-free language [ 11 ]. 

2 Nilpotent and polycyclic groups 

Let A be a square matrix of dimension d over some commutative ring R. With 
A[i, j] we denote the entry of A in row i and column j. The matrix A is called 
triangular if A[i,j] — 0 whenever i > j , i.e., all entries below the main diagonal 
are 0. A unitriangular matrix is a triangular matrix A such that A[i,i] = 1 
for all 1 < i < d. i.e., all entries on the main diagonal are 1. We denote the 
set of unitriangular matrices of dimension d over the ring R by UT^R). It is 
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well known that for every commutative ring R, the set UT t ;(i?) is a group (with 
respect to matrix multiplication). 

An n-step solvable group G is a group G that has a a subnormal series 
G = G n \> G n -1 > G n -2 > • • • > G\ D> Go = 1 (i.e., G; is a normal subgroup 
of Gi +1 for all 0 < i < n — 1) such that every quotient Gi+i/Gi is abelian 
(0 < i < n — 1). If every quotient Gi+i/Gi is cyclic, then G is called polycyclic. 
The number of0<*<n—1 such that Gj+i/Gj = Z is called the Hirsch length 
of G; it does not depend on the chosen subnormal series. If Gj+i/G,; = Z for all 
0 < i < n—1 then G is called strongly polycyclic. The following characterizations 
of the class of polycyclic groups are known: 

• A group is polycyclic if and only if it is solvable and every subgroup is 
finitely generated. 

• A group is polycyclic if and only if it is a solvable group of integer matrices; 
this is a famous result by Auslander and Swan [2, 24] . In particular, every 
polycyclic group is linear, i.e., can be embedded into a matrix group over 
some field. 

For a group G its lower central series is the series G = Go > G\ [> Gi > • • • 
of subgroups, where Gj+i = [G.;,G], which is the subgroup generated by all 
commutators [g, h] with g £ Gi and h £ G. Indeed, Gj+i is a normal subgroup 
of Gj. The group G is nilpotent of class c, if G c = 1. Every f.g. nilpotent group 
is polycyclic, and every group UT<j(Z) (d > 1) is f.g. nilpotent of class d — 1. 

The group UT 3 (Z) is also denoted by H 3 (T) and called the discrete Heisen¬ 
berg group. Thus, H 3 (Z) is the group of all (3 x 3)-matrices of the form 

lac 

0 1 b 
0 0 1 

for a, b, c, £ Z. The center Z(H 3 (R)) of this group consists of all matrices of the 
form 

1 0 c 

0 1 0 
0 0 1 

for c £ Z. The group ff 3 (Z) is nilpotent of class two (it is in fact the free 
nilpotent group of class two and rank two). In other words, every commutator 
ABA~ 1 B~ 1 (A, B £ H 3 (7j)) belongs to the center Z(H 3 (Z)). The identity 
(3 x 3)-matrix will be denoted by M 3 . Clearly, a direct product of copies of 
H 3 (X) and Z is also nilpotent of class two. 

We need the following results about nilpotent groups: 

Theorem 2.1 (Theorem 17.2.2 in [12]). Every f.g. nilpotent group G has a 
torsion-free normal subgroup H of finite index (which is also f.g. nilpotent). 

Theorem 2.2 (Theorem 17.2.5 in [12]). For every torsion-free f.g nilpotent 
group G there exists d > 1 such that G can be embedded into UTd(Z). 

A group is virtually nilpotent if it has a nilpotent subgroup of finite index. 
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3 Subset sum and knapsack problems in groups 

Let G be a f.g. group, and fix an arbitrary finite generating set E for G. In this 
paper, we consider the following computational problems for G, where elements 
of G are represented by finite words over SUE -1 : 

• Subset sum problem for G (briefly SSP(G)): Given gi,...,gk,g 6 G, 
decide whether there exist £ 1 ,..., £k G {0,1} such that g = g 1 ) 1 ■ ■ ■ g e k . 

• Knapsack problem for G (briefly KP(G)): Given gi,... ,gk>g € G, de¬ 
cide whether there exist natural numbers e\ ,..., e*, > 0 such that g = 

ei €if 

9i ■■■9k ■ 

These problems were studied for general f.g. groups in [22, 7], where among 
others the following results were shown: 

• The subset sum problem for every f.g. virtually nilpotent group can be 
solved in polynomial time [22]. 

• The subset sum problem and the knapsack problem for every hyperbolic 
group can be solved in polynomial time [22]. 

• The knapsack problem can be solved in polynomial time in any free prod¬ 
uct of hyperbolic groups and finitely generated abelian groups [7]. 

• The subset sum problem for the following groups is N P-complete: Z l Z, 
free metabelian (but non-abelian) groups of finite rank, and Thompson’s 
group F [22], 

There is a variant of knapsack, where we ask wether for given gi ,..., gk, g € G, 
there exist integers e \,..., 6 Z such that g = ffi 1 " ' 9k k > he., whether g 

belongs belongs to the product of cyclic groups (g i) • • • (gk)- This second version 
is reducible to the above version with exponents from N: Simply replace g^‘ 
(with e,; from Z) by (g~ ) di (with c*, di from Z). We will prove undecidability 
results for the “easier” version with integer quotients, whereas decidability results 
will be shown for the harder version with positive exponents. 

4 Subset sum problems in nilpotent groups 

In this section, we show that the subset sum problem for a finitely generated 
virtually nilpotent group belongs to nondeterministic logspace (NL). This is the 
class of all problems that can be solved on a nondeterministic Turing-machine 
with a working tape of length 0(log?r), where n is the length of the input, see 
e.g. [1] for details. Actually, we consider a problem more general than the subset 
sum problem: the membership problem for acyclic finite automaton, which was 
also studied in [7]. 

Recall that a finite (nondeterministic) automaton over a finite alphabet E 
is a tuple A = ( Q , A, qo,F), where 


4 



• Q is a finite set of states, 

• ACQxS’xQisa finite set of transitions, 

• 9 o £ Q is the initial state, and 

• F C Q is the set of final states. 

If the directed graph (Q,{(p,q) | £ E* : ( p,w,q ) £ A}) has no directed 

cycle, then the finite automaton A is acyclic. An accepting run for a word w 
is a sequence of transitions (qo,wi,qi), ( 91 ,^ 2 , 92)5 • ■., {q n -iiW n ,q n ) £ A such 
that w = W 1 W 2 ■ ■ ■ w n and q n £ F. The language L(A) C E* is the set of 
all words over E that have an accepting run. By splitting transitions, one can 
compute in logspace from a finite automaton A an automaton B such that 
L(A) = L(B) and all transitions of B are from Q x (E U {e}) x Q. Moreover, B 
is acyclic if A is acyclic. 

Let G be a finitely generated group, and let E be a finite group generating 
set for G. Hence, E U E _1 generates G as a monoid and there is a canonical 
homomorphism h : (E U E -1 )* —x G. For a finite automaton A over E U E -1 
and a word x £ (E U E -1 )* we also write x £<3 L(A) for h(x) £ h(L(A)). The 
acyclic rational subset membership problem for G (briefly ARatMP(G)) is the 
following computational problem: 

Input: An acyclic finite automaton A over EUE -1 and a word 1 £ (ELIE -1 )*. 
Question: Does x £g L(A) hold? 

Clearly, SSP(G) is logspace reducible to ARatMP(G). 

Theorem 4.1. For every d> 1, ARatMP(UT t ;(Z)) belongs to NL. 

Proof. Let A be a finite automaton with n states, whose transitions are labelled 
with generator matrices of UTrf(Z) or the identity matrix. We nondeterministi- 
cally guess a path of length at most n from the initial state of A to a final state of 
A and thereby multiply the matrices along the path. We only store the current 
state of A, the product of the matrices seen so far, and the length of the path 
travelled so far (so that after n steps we can stop). The state of the automaton 
as well as the length of the path need 0(log n) bits. Hence, we only have to show 
that the product matrix can be stored in logarithmic space. For this, it suffices 
to show that the matrix entries are bounded polynomially in n. Then, the bi¬ 
nary coding of the matrix needs only 0 (log n) many bits (note that the matrix 
dimension d is a constant). For this, we can use the following simple result (see 
[17, Proposition 4.18] for a proof), which only holds for unitriangular matrices: 
For a (d x ci)-matrix M = ( a i,j)i<i,j<d over Z let \M\ = J2i=i I2j=i Kil- Let 
Mi,..., M n £ UTd(Z), n > 2 d, and let m = max{|Mj| | 1 < i < n}. For the 
product of these matrices we have 


|MiM 2 ---M„| <d+(d- 1) 



d 2( d -2) m d -\ 
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In our situation, the matrices M; are from a fixed set (generators and the iden¬ 
tity matrix). Hence, m and also d are constants. Hence, the above bound is 
polynomial in n, which means that every entry of the product M\ ■ ■ ■ M n can 
be stored with 0(log n) bits. □ 

Theorem 4.2. Let H be a finite index subgroup of the f.g. group G (hence, H 
is f.g. too). Then ARatMP(G) is log space-reducible to ARatMP(H). 

Proof. Let G and H be as in the statement of the theorem. Let T (resp., E) be 
a finite generating set for G (resp., H). Let Hgo, Hgi, ..., Hg n be a list of all 
right cosets of H , where go = 1. 

Let A = (Q, A, qo, F) be an acyclic finite automaton over the alphabet 
rur - 1 and let x £ (ruT -1 )*. We can assume that A C Q x (ruT -1 U{e}) x Q. 
Assume that x = yg s in G, where y £ (E U E -1 )*. We can compute the word y 
and the coset representative g s in logspace as follows: Let x = ai(i 2 • • • a m . We 
store an index i £ {0,..., n}, which is initially set to 0. Then, for 1 < j < m we 
do the following: If ggi-j = wgk for w £ (E U E -1 )*, then we append the word 
w at the output tape and we set i := k. At the end, the word y is written on 
the output tape and the final index i is s such that x = yg s . 

We now construct a new acyclic automaton B over the alphabet E U E _1 as 
follows: 

• The state set is Q x {g 0 ,g\ ■ ■ ■ ,g n }- 

• Assume that (p, a, q) £ A is a transition of A (a £ T U T -1 U {e}) and let 
i £ {0,1,... ,n}. Assume that gyi = wgj in G, where w £ (E U E -1 )*. 
Then, we add the transition (( p,gi),w , ( q,gj )) to B. 

• The initial state of B is (qo,go)- 

• The set of final states of B is F x {g s }. 

From the construction, we get x £q L(A) if and only if y £h L(B). □ 

Theorem 4.3. Let G be finitely generated vii'tually nilpotent. Then, the problem 
ARatMP(G) is NL -complete. 

Proof. Hardness for N L follows immediately from the N L-hardness of the graph 
reachability problem for acyclic directed graphs. For the membership in NL let 
G be finitely generated virtually nilpotent. By Theorem 2.1 and 2.2, G has a 
finite index subgroup H such that H is isomorphic to a subgroup of UTd(Z). 
W.l.o.g we assume that H is a subgroup of UTd(Z). Membership in NL follows 
from Theorem 4.1 and Theorem 4.2. □ 

By Theorem 4.3, the subset sum problem for a finitely generated virtually 
nilpotent belongs to NL. It is open, whether this upper bound can be further 
improved. In particular, it is open whether the subset sum problem for the 
Heisenberg group I? 3 (Z) can be solved in deterministic logspace. Recall from 
the introduction that subset sum for Z (and unary encoded numbers) belongs 
to DLOGTIME-uniform TC° which is a subclass of deterministic logspace. This 
result generalizes easily to any f.g. abelian group. 
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5 Subset sum in polycyclic groups 

We show in this section that there exists a polycyclic group with an N P-complete 
subset sum problem, which is in sharp contrast to nilpotent groups (assuming 
NL ^ NP). Let us start with a specific example of a polycyclic group. Consider 
the two matrices 



where a £ R, a > 2. Let G a = {g a ,h) < Gl_ 2 (K). Let us remark that, for 
instance, the group Gi is not polycyclic, see e.g. [25, p. 56]. On the other hand, 
we have: 

Proposition 5.1 (c.f. [14]). The group G l+ ^ is polycyclic. 

Theorem 5.2. SSP(G 1+% / 2 ) is NP -complete. 

Proof. Let a = 1 + \/2. We follow the standard proof for the N P-completeness 
of subset sum for binary encoded integers. But we will work with real numbers 
of the form 

n 

x = ^2 Xi ■ a 3z , 

2=0 

where the Xi are natural numbers with 0 < Xi < 5. The numbers x- t are uniquely 
determined by x in the following sense: 

Claim 1: If 

n m 

^ x t ■ a il = y y l ■ a 31 (5.1) 

i—0 i— 0 

with xq , .. .x n ,y 0 ,... ,y m £ {0,1,..., 5} and / 0 / y m , then n = m and 
Xi = j/i for all 0 < i < n. 

Proof of Claim 1. Assume that the conclusion of the claim fails. Then, by 
canceling a-powers with highest exponent, we obtain from 5.1 an identity of the 
form 

n m 

^2 x i ' aSl = Vi ' 
i= 0 2—0 

where n > m, Xo,.. .x n ,yo,... ,y m € {0,1,..., 5} and x n ^ 0. In order to lead 
this to a contradiction, it suffices to show 

n —1 

a 3n > J2 5 • « 3i - 

i—0 

Indeed, we have 

n-l n—1 3n-l 3n _ 

5 • a 3i < ^(« 3i + « 3i+1 + « 3i+2 ) = J2 a * = _/ < « 3n - 

2=0 2=0 2=0 a 
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Let us now take a 3CNF-formula C = /\Hi Cj, where C.-, = (z^i V Zi t 2 V 2^3). 
Every Zij is a literal, i.e., a boolean variable or a negated boolean variable. Let 
x% f ...,x n be the boolean variables appearing in C. 

We now define numbers Ux,... ,U2n+2m, and t as follows, where 1 < i < n 
and 1 < j < to: 


U 2 i -1 

= a 3i " 3 + a 3n+3k ~ 3 


Xi^Ck 

U 2 i 

= a 3i ~ 3 + Y a 3n+3k ~ 3 


Xi^Ck 

U 2 n+ 2 j-l 

= U 2 n+ 2 j = a 3n+3j ~ 3 


n m 

t 

= Y a3i ~ 3 + J2 3 - a3n+3k ~ 


i=l fc=l 

Claim 2: C is satisfiable if and only if there exists a subset I C {1,..., 2n + 2?n} 
such that Uk = t- 

Proof of Claim 2. First assume that C is satisfiable, and let ip : { 2 : 1 ,... ,x n } —> 
{0,1} be a satisfying assignment for C. We set p(xi) = 1 — <p(xi). For every 
clause Cj = (27 1 V Zj t 2 V Zj t 3 ) let 7 j = \{k G {1,2,3} | ip(zj t k) = 1}| be the 
number of literals in Cj that are true under ip. Thus, we have 1 < < 3. 

We define the set I as follows, where 1 < i < n and 1 < j < m: 

• 2i — 1 G I iff <p(xi) = 1 

• 2i G I iff ip(xi) = 0 

• If 7 j = 3, then 2n + 2j — 1 ^ I and 2 n + 2j ^ I. 

• If 7 j = 2, then 2n + 2j — 1 G / and 2n + 2j ^ I. 

• If 7 j = 1, then 2n + 2j — 1 G / and 2n + 2j G /. 

With this set I we have indeed Yhkei Uk = t- 

For the other direction, let I C {1,..., 2n + 2 to} such that JA-e/ Uk ~ 
Note that in the sum ^2 keI u k no power a 3k can appear more than 5 times (a 
power a 3 ” +3j-3 with 1 < j < m can appear at most 5 times, since it appears 
in 3 of the numbers u\,... ,U 2 n and in 2 of the numbers U 2 n +i, ■ ■ ■ ,U 2 n+ 2 m)- 
This allows to use Claim 1. A comparision of t and XAe/ Uk shows that either 
2i — 1 G I or 2i G I. We define the assignment ip : { 27 ,... ,x n } —> {0,1} as 
follows: 

• ip(xi) = 1 iff 2i — 1 G I 

• p(xi) = 0 iff 2i G / 
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As above, let *yj be the number of literals in Cj that are true under ip. Moreover, 
let Sj = \I fl (2?r + 2 j — 1,2 n + 2j}\ for 1 < j < m. We get 


E «* = E « 3 ?_ 3 +E(^ + s j )- « 3n+3j “ 3 = t = E a 3 ?_ 3 +E 3 • « 3n+3j_3 - 

k£l i— 1 j =1 i=l j=l 

Since Ay £ {0,1, 2} we must have jj > 1 for all 1 < j < m. This shows that ip 
satisfies C. 

We now map each of the numbers Ui,, U 2 n+ 2 mi f to a word over the gen¬ 
erators g a , h (and their inverses) of the polycyclic group G a . First, for i > 0 let 
us define 

m = g l a hg~ l 

In the group G a we have 

Wi = 

Finally, take a number Y = Vi 

w Y =\\wf. 

i= 0 

In the group G a we have 

( 1 Y 

WY = V o 1 

The words w Ul , ■ ■ ■, w U2n+2m , Wt can be computed in polynomial time (even in 
logspace) from the 3CNF-formula C. Moreover, the construction implies that C 
is satisfiable iff there exists a subset I C {1,..., 2n + 2?n} such that ^2 keI u k = t 
iff there are ei, ..., £ 2 n+ 2 m G { 0 ,1} such that w^\ ■ ■ ■ w U2 ”(( 2 "( = wt in the group 
G a . □ 


f 1 a 1 
VO 1 

• a 1 . We define the word 


6 Knapsack problems in nilpotent groups 

The goal of this section is to prove that the knapsack problem is undecidable 
for a direct product of sufficiently many copies of which is nilpotent of 

class two. 

6.1 Exponential expressions 

Let A be a countably infinite set of variables. An exponential expression E over 
a group G is a formal product of the form 

E = g x 1 'g?---g? 

with x\,... ,xi £ X and gi,... ,gi £ G. We do not assume that Xi ^ Xj for 
i ^ j. The group elements gi,... ,gi will be also called the base elements of E. 
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The length of E is l. Let Var (E) = {cci,... ,x n } be the set of variables that 
appear in E. For a finite set X with Var (E) C X C X and g £ G, the set of 
X-solutions of the equation E = g is the set of mappings 

S X (E = g) = {u : X -> Z | • • • g v ™ = g in G}. 

Note that not every variable from X has to appear as an exponent in E. We 
moreover set S(E = g) = S'var(E)(L' = g)- 

For every 1 < i < n consider an exponential expression Ei over a group 
Gi. Then we can define the exponential expression E = ]~[" =1 Ei over the group 
G = nti Gi- ^ is defined by replacing in Ei every occurrence of a base element 
g £ Gi by the corresponding element 

( Ii ■ — > \ ><?> V • — i f ) € G 

i — 1 many n — i many 

and taking the concatenation of the resulting exponential expressions. With 
this definition, the following lemma is obvious. 

Lemma 6.1. For 1 < i < n let Ei be an exponential expression over a group 
Gi. Let gi £ Gi for 1 < i < n. Let X = (J" =1 Var (Ei). Then for the exponential 
expression E = n"=i Pi an d the element g = (gi,... ,g n ) £ JllLi Gi we have: 

n 

S X (E = g) = p| Sx(Ei = gi ). 

i=1 

Proposition 6.2. There are fixed constants d, e £ N and a fixed exponential 
expression E over G = H^(fL) d x Z e such that the following problem is undecid- 
able: 

Input: A element g £ G. 

Question: Does S(E = g) ^0 hold? 

Proof. Let P(x i,..., x n ) £ Z[xi ,..., x n ] be a fixed polynomial such that the 
following question is undecidable: 

Input: A number a £ N. 

Question: Is there a tuple (zi ,..., z n ) £ Z” such that P(zi ,..., z n ) = a. 

By Matiyasevich’s proof for the unsolvability of Hilbert’s 10th problem, we know 
that such a polynomial exists, see [20] for details. By introducing additional 
variables, we can construct from the polynomial P(x i,... ,x n ) a system S of 
equations of the form x- y = z,x + y = z,x = c (for c £ Z) such that the 
equation P{x \,..., x n ) = a has a solution in Z if and only if the system of 
equations S a := S U {^o = a} has a solution in Z. Here Xq is a distinguished 
variable of S. Let X be the set of variables that occur in S a - 

Take an integer a £ Z (the input for our reduction). Assume that S a contains 
d many equations of the form x ■ y = z and e many equations of the form 
x + y = z or x = c. Enumerate all equations as £\,, £d+e, where £\,... ,£d 
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are all equations of the form x-y = z. Let Gi = H^(7) for 1 < i < d and Gj = Z 
for(i+l<«<d + e We define for every 1 < i < d + e an element gj £ Gi and 
an exponential expression Ei over Gi as follows: 

Case 1. Si = (x ■ y = z) and thus Gj = H 3 (Z). Then, we set g, = M 3 (the 
identity matrix) and 

/I 0 o\ x /1 1 oY (l 0 oY /1 -1 0 \® /I 0 lY 

£) = 0 1 10 10 0 1-10 1 0 0 1 0 . 

\0 0 1/ \0 0 1 ) \0 0 1/ V° 0 l ) \° 0 V 

One can easily check that a mapping v : X —> Z is a solution of Ei = gi if and 
only if v(x) ■ v(y) = v(z). 

Case 2. Si = (x + y = z) and thus Gi = Z. Then, gi = 0 and Ei is (written in 
additive form) Ei = x + y — z (or, written multiplicatively, Ei = a x d v a~ z , where 
a is a generator of Z). Then, a mapping v : X —> Z is a solution of E, = gi if 
and only if v{x) + v{y) = v{z). 

Case 3. Si — (x = c) (this includes the distinguished equation Xq = a) and thus 
Gi = Z. Then, gi = c and Ei = x (or, written multiplicatively, Ei = a x ). Then, 
a mapping v : X —> Z is a solution of Ei = gj if and only if ^(a;) = c. 

Let E = and g = ( 51 ,..., g^). By Lemma 6.1, a mapping v : X —> Z 

is a solution of E = g if and only if v is a solution of the system S a . Also note 
that g £ G depends on the input integer a, but the exponential expression E 
only depends on the fixed polynomial P(x 1 ,..., x n ). □ 

Remark 6.3. The fixed exponential expression E from Proposition 6.2 has the 
following property that will be exploited in the next section: We can write 
E = E\ E 2 * * * E m such that every Ej has length at most 4 and every base 
element g from Ei commutes with every base element h from Ej whenever 
i j. For this, note that the last matrix in the exponential expression from 
Case 1 is central in 1?3(Z). 

6.2 Undecidability of knapsack for nilpotent groups of 
class two 

Let E = g x 1 g % 2 • • • gf l be an exponential expression over the f.g. group G and 
let X = Var (E). Consider the group GxZ ! . For 1 < i < l let £ 1} be the 
i-th unit vector from T. 1 . For every x £ X define 

e x = e* £ 7} and h x = (l,e x ) £ G x Z*. 

l<i<l,Xi=x 

Note that h x is central in GxZ 1 . Moreover, for 1 < i < l let 

hi = (gi, — ej) £ G x 7}. 
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Then, for a given group element g G G, we have S(E = g) ^ 0 if and only if 

i 

(5,0) G P (M 

x£X i —1 

By applying the above construction to the fixed exponential expression E over 
the fixed group G = H 3 (Z) d x Z e from Proposition 6.2, we obtain (note that 
Z < H 3 (Z)): 

Theorem 6.4. There exist a fixed constant d and a fixed list g±,... ,g\ G H 3 (Z) d 
of group elements such that membership in the product nii (9i) is undecidable. 

In particular, we have: 

Theorem 6.5. There exists a fixed constant d such that K.P(H 3 (Z) d ) is unde¬ 
cidable. 

Finally, from the construction in the previous section, we also obtain the 
following undecidability result. 

Theorem 6.6. There exist a fixed constant d and a fixed list of four abelian sub¬ 
groups Gi, G 2 , G 3 , G 4 < H 3 (Z) d such that membership in the product G 1 G 2 G 3 G 4 
is undecidable. 

Proof. Recall from Remark 6.3 that the exponential expression from Proposi¬ 
tion 6.2 can be written as E\ E? ■ ■ ■ E m such that every Ei has length at most 
4, and every base element g from E, commutes with every base element h from 
Ej whenever i j. The above construction implies that the sequence of group 
elements g 3 , g 2 , ■ ■ ■ , g\ from Theorem 6.4 can be split into blocks B 3l B 2 , ■ ■ ■, B^ 
of length at most 4 such that every group element from block Bi commutes 
with every group element from Bj whenever i ^ j. This allows to rearrange 
the product of cyclic groups nil (hi) as a product of four abelian subgroups 
Gi, G 2 , G 3 , G 4 , where Gj is generated by all group elements, which are at the 
i-th position in their block. □ 

Remark 6.7. In contrast to Theorem 6.6, it was shown in [16] that a product 
of two subgroups of a polycyclic group is closed in the profinite topology. Since 
polycyclic groups are finitely presented it follows that membership in a product 
of two subgroups of a polycyclic group is decidable. This leaves open whether 
membership in a product of three subgroups of a polycyclic (or nilpotent) group 
is decidable. 

Let us finally prove that the knapsack problem for the discrete Heisenberg 
group H 3 (Z) is decidable. 

Theorem 6.8. For every e > 0, KP(L/ 3 (Z) x Z e ) is decidable. 
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Proof. Let us first show the result for Take matrixes A, Ai ,..., Ai £ 

i? 3 (Z) and let 


A = 


/ 1 

a 

C \ 



/ 1 

ai 

d \ 

0 

1 

b 

and 

Ai = 

° 

i 

bi 

V 0 

0 

i y 



V 0 

0 

i y 


A straightforward induction over n shows that 

i i u (n—l)r. 

1 a* • n Ci-n + ciibi-——- 

A™ = I 0 1 bi ■ n 


0 0 


1 


Hence, there is a solution (x \,..., xi) eff 1 of A = A* 1 ■ ■ ■ Af l if and only if the 
following system of three Diophantine equations has a solution over N: 


i 

a = di ■ Xi 

i—l 

l 

b = J2 bi ■ Xi 

i=1 



i= 1 i=l 


l<i<j<Z 


CLibnXiXn 


This is a Diophantine system with a single quadratic equation and two linear 
equations. By [4], a system consisting of a single quadratic Diophantine equation 
together with an arbitrary number of linear equations can be reduced to a single 
quadratic Diophantine equation, which has the same solutions over Z. By [9], 
one can decide whether this quadratic Diophantine equation has a solution over 

N. 

Finally, the above proof also works for the group Hz( Z) x Z e , since we only 
get additional linear equations. □ 

Corollary 6.9. The class of f.g. groups with a decidable knapsack problem is 
not closed under direct products. 

Proof. This follows directly from Theorem 6.5 and 6 . 8 . □ 


7 Knapsack problems for finite extensions 

We show that in contrast to direct products, decidability of the knapsack prob¬ 
lem is preserved under finite extensions. For this, it will be convenient to 
consider a slightly extended version of the knapsack problem, which we will 
prove equivalent (with respect to polynomial time reducibility) to the knapsack 
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problem. The generalized knapsack problem (briefly GKP(G)) is the following 
decision problem: Given gi, ■ ■ ■ ,gk £ G and /o, ■ • •, fk G G, decide whether 

fo9Th92 2 h ' '■9k k fk = 1 (7.1) 

for some m,... ,nk £ N. An instance of the generalized knapsack problem is 
therefore a tuple (/ 0 , gi, fi,..., gk, fk) with /o,..., fk £ G and gi ,..., g k G G. 
If (7.1) holds, we call the tuple (ni,... ,nk) a solution. If two instances have 
the same set of solutions, we call them equivalent. 

Proposition 7.1. KP(G) and GKP(G) are inter-reducible in polynomial time. 

Proof. Since g " 1 • • • g]) k = g if and only if g~ 1 g ™ 1 • ■ ■ g'ff = 1, KP(G) clearly 
reduces to GKP(G) in polynomial time. 

Let us reduce GKP(G) to KP(G). Let (/o, <7i, /i, • • ■, gk , fk ) be an instance 
of GKP(G). Observe that since gf l /,; = fi{f~ l gifi) ni , if we replace /*_!, g t , 
and fi by /)_]/,:, f. i f 1 gifi and 1, respectively, we obtain an equivalent instance 
in which fi = 1. By repeating this step k times, starting with fk, we arrive at an 
instance with fi = • • • = fk = 1. Then, clearly, /off" 1 • • ■ gff = 1 is equivalent 

to< 1 ---C=/o“ 1 - ' ■ ■ ■ n 

From now on, let G be finitely generated and H be a finite index subgroup 
of G, which is therefore finitely generated too. Furthermore, let R C G be a 
finite set of representatives of right cosets of H in G. Then for each g G G, 
there is a unique p(g) G 1? such that g G Hp{g). Also recall from the proof 
of Theorem 4.2 that from a given element g G G we can compute effectively a 
decomposition g = hr with h £ H and r £ R. This fact will be implicitly used 
throughout this section. 

Lemma 7.2. Let gi,g 2 £ G and p^gigf) = p{gi)- We can compute h\,h 2 £ H 
and r £ R such that gig 2 = hih\r for every t > 0. 

Proof. Since p{gig 2 ) = p(gi), we can write g\ = h\r and 51^2 = h- 12 r for 
h \, hi 2 £ H and r £ R. Moreover, we can find /12 G H and r 2 £ R with 
rg -2 = /i 2 C 2 • Then 

hi 2 r = .9132 = hirg 2 = hih 2 r 2 

and hence r 2 = r. This means rg 2 = h 2 r and thus rg^ = h* 2 r and 


9i9 2 = hirgl = hih\r. 


□ 

Theorem 7.3. Let H be a finite-index subgroup of a finitely generated group 
G. Then KP(G) is decidable if and only i/KP(iL) is decidable. 

Proof. Since the “only if” direction is trivial, it remains to prove the “if’ di¬ 
rection. According to Proposition 7.1, it suffices to show that if GKP(IL) is 
decidable, then GKP(G) is decidable. 
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We say that an instance / = (/o, gi, fi, ■ ■ ■, gk, fk) of GKP(G) is j-pure 
if /o 1gii ■ ■ ■ ifj-\i 9 j € H. In particular, every instance is 0-pure. We call an 
instance pure if it is fc-pure. If an instance is j-pure, but not (j + l)-pure, then 
k — j is its impurity. 

First, we prove the following claim by induction on the impurity of I: For 
every instance / = {fo,gi, fi, ■ ■ ■ , 9 k, fk) of GKP(G), we can construct finitely 
many pure instances of GKP(G) such that the solution set of I is the union of 
affine images of their solution sets. 

Suppose / is j-pure but not (j + l)-pure. Write fj = hr for h £ H and 
r £ R. Since R is finite, there are m,£ £ N with p(rg ^. 1 ) = p(rgj^[ e ). We use 
Lemma 7.2 to find h±,h 2 £ H and r' £ R such that rgj^ u = hih^r' for all 
t > 0. In particular 

fjOT+i 1 = hrg? + \ U = hhihlr 1 . 

We can also find for each 0 < s < m elements h s £ H and r s 6 R with = 
h s r s . Finally, we can find for each 0 < s < i a decomposition r'g s ^ +1 = h s f s 
with h s £ H, f s £ R. Note that each element /j can be written in one of 
the following forms: 

fjPj'+i = hh a f s for some 0 < s < m, 

fjPj'+i = hh\h\h s f s for some 0 < s < £ and t > 0. 

Here, the first equality holds if n < m and the second one holds if n > m and 
n = m + t£ + s with 0 < s < l. 

We therefore construct two types of instances. The first type consists of the 
instances 

(/o; 9 i i /ii ■ • • > 9 j —i j fj— ii 9 ji hh s r s f j+1 , gj+ 2 , fj+ 2 , ■ ■ ■ > fk)i 

for 0 < s < m. The second type consists of instances 

(fo,gi,fi, ■ ■ ■ ,9j-i,fj-i,9j,hhi, /12, h s f s fj+i,gj+2, fj+2, ■■■,gk, fk) 

for each 0 < s < l. Observe that I has a solution if and only if one of these 
new instances has one. Furthermore, each of these instances has lower impurity 
than I. Hence, the induction hypothesis yields the desired finite set of instances. 
This proves our claim. 

Let us now prove the theorem. Given an instance I of GKP(G), we construct 
pure instances Ii ,... ,I m of GKP(G) such that I has a solution if and only if 
one of Ji, ..., I m has one. Since I., is pure, if /, = (/o, gi, fi, ■ ■ ■, gk, fk), then 
/o, gi, ..., fk-i, 9k 6 H, but fk may not be in H. However, the equation 

fo 9 ? 1 fi--- 9 ?fk = l 

can only have a solution if £ H. Moreover, ii fk £ H, then I is in fact an 
instance of GKP(if). Since we can decide whether fk £ R, we can pick from 
Ji,..., I rn those that are instances of GKP(Hj. This means, from I we have 
constructed finitely many instances of GKP(if) such that / has a solution if 
and only if one of the new instances has one. This proves the theorem. □ 
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8 Knapsack problems for co-context-free groups 

In this section, we exhibit another class of groups with a decidable knapsack 
problem, namely co-context-free groups, which we introduce first. 

A language is a subset of a free monoid X*, where X is an alphabet, i.e. a fi¬ 
nite set of abstract symbols. A context-free grammar is a tuple T = (N, T, P, S), 
where 

• N and T are disjoint alphabets, their members are called nonterminals 
and terminals, respectively, 

• P C N x (N U T)* is a finite set of productions, 

• S € N is the start symbol. 

A production (A, w) £ P is also denoted A —> w. In a context-free grammar, 
the productions allow us to rewrite words. Specifically, for u, v £ ( N U T)*, we 
write u =^r v if there are x, y £ (N LIT)* such that u = xAy and v = xwy for 
some production A —> w in P. Furthermore, =>p denotes the reflexive transitive 
closure of =>r- The language generated by T is then defined as 

L(T) = {w e T* | S =>r w}. 

A language is called context-free if it is generated by some context-free grammar. 

Let E be a finite generating set of the group G and let ft: (ELI E -1 )* —»• G 
be the canonical monoid homomorphism. The word problem and the co-word 
problem (with respect to E U E -1 ,) of G are the languages 

{w € (E U E^ 1 )* | h(w) = 1} and 
{toe (E U E -1 )* | h(w) ± 1} 

respectively. Since it does not depend on the chosen generating set whether 
the word problem or the co-word problem are context-free [11], we may de¬ 
fine a group G to be (co-)context-free if its (co-)word problem is a context-free 
language. Co-context-free groups were introduced by Holt, Rees, Rover, and 
Thomas [11] and shown to significantly extend the class of context-free groups 
(which are, by a well-known result of Muller and Schupp and Dunwoody, pre¬ 
cisely the virtually free groups [21, 5]): The class of co-context-free groups is 
closed under taking direct products, taking restricted standard wreath products 
with a context-free top-group, passing to finitely generated subgroups and finite 
index overgroups. Furthermore, Lehnert and Schweitzer [15] have shown that 
the Higman-Thompson groups are co-context-free as well. 

Theorem 8.1. Every co-context-free group has a decidable knapsack problem. 

Note that this means in particular that the wreath product Z l Z has a 
decidable knapsack problem, which is in contrast to the fact that this group has 
an undecidable submonoid membership problem [19]. 
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Proof of Theorem 8.1. Let W be the co-word problem of G with respect to 
E U E _1 and let W be context-free. 

We will need some terminology. A language L C A* is called regular if it 
can be obtained from the empty set and the singletons {a:}, x £ A, by the 
operations 

• union, which turns K C A* and MCA* into K U M, 

• concatenation, which turns K,M C X* into {uv \ u £ K, v £ M}, and 

• iteration, which maps M C A* to the submonoid of A* generated by M. 

For every context-free language L C A*, homomorphisms a: X* Y* and 
/ 3: Z* —> X* and regular language K C A*, the languages a(L), j3^ l {L), and 
L n K are context-free as well and we can effectively compute a grammar for 
the resulting languages [3]. 

Suppose we are given gi,...,g^,g as an instance of the knapsack problem, 
and let these elements be written as words Wi,...,Wk,w, respectively, over 
EUE -1 . Consider the alphabets A = {ai,..., a*,}, Y = AU{a}, and the homo¬ 
morphisms a: Y* —> (EUE -1 )*, with a(ai) = Wi for 1 < i < k and a(a ) = w . 
Here, w^ 1 is the word obtained by inverting the generators and then reversing 
the word. Furthermore, observe that the language K = {ai}* • • • {afc}*{a} is 
regular. Moreover, let /3: Y* —> X* be the homomorphism with f3(ai) = a,; for 
1 < i < k and /3(a) = e. Then, the language 

M = P(a-\W) n K) = K 1 • • • af \ g? ■ ■ ■ g? # g} 

is effectively context-free. Clearly, there exist ei,..., e*, £ N with g J 1 • • • g^f = g 
if and only if M ^ {ai}* • • • {aj,}*. In order to decide the latter, we will employ 
Parikh’s Theorem. 

For each w C A*, let 'F(ie) = (ei,..., e*), where e, is the number of occur¬ 
rences of ai in w for 1 < i < k. The resulting map U/: A* —»• N fe is called the 
Parikh map. Parikh’s Theorem [23] states that for each context-free L C A*, 
its Parikh image 'F(L) = {'F(ie) | w £ L} is semilinear, meaning that it is a 
finite union of sets of the form 

{u 0 + xi ■ Vi + • • • + x n ■ v n | xi ,..., x n £ N}, 

where uo £ N fc and v\,... ,v n £ N fc are called the base vectors and the period 
vectors, respectively. Again, Parikh’s theorem is effective, meaning that given a 
context-free grammar, we can compute base vectors and period vectors for its 
semilinear Parikh image. 

Furthermore, given a semilinear set S C N fc , its complement N fc \ S is 
effectively semilinear as well [8]. Since M = {ai}* • • • {a*,}* if and only if 
’F(M) = N fc , we can compute N fc \ 'F(M) and check if it is non-empty. This 
concludes the proof of the theorem. □ 
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